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Chaos in temperature in generic 2p-spin models 


Dmitry Panchenko* 


Abstract 

We prove chaos in temperature for even p-spin models which include sufficiently many 
p-spin interaction terms. Our approach is based on a new invariance property for coupled 
asymptotic Gibbs measures, similar in spirit to the invariance property that appeared in the 
proof of ultrametricity in 1231, used in combination with Talagrand’s analogue of Guerra’s 
replica symmetry breaking bound for coupled systems. 
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1 Introduction 

The phenomenon of chaos in temperature in spin glass models was first studied in the physics 
literature by Fisher and Huse [fT3l and Bray and Moore [O and can be briefly described as follows. 
One can show in some spin glass models, such as the Sherrington-Kirkpatrick and mixed p-spin 
models, that the Gibbs distribution of the system at a given temperature is concentrated near some 
constant level of energy (at the right scale) and this level can change with temperature. Chaos 
in temperature means that the set of likely configurations looks quite different even if we change 
temperature only slightly, and if we sample two spin configurations from the Gibbs distributions 
at different temperatures then their overlap will be almost deterministic. It means that the two 
systems might have a common preferred direction, for example in the presence of external field, 
but otherwise are completely uncorrelated. This is in contrast with the behaviour of the overlap 
of two configurations from the system at the same temperature, which may have a non-trivial 
distribution according to the Parisi ansatz (see [l2Tl|25l|32l). In this paper, we will prove chaos in 
temperature for mixed even p-spin models that include sufficiently many p-spin interactions. 

We will consider a mixed p-spin model, which is a generalization of the Sherrington-Kirkpatrick 
model [|28l . corresponding to the Hamiltonian 

Hn{o) = ^ ypHN,p{o) ( 1 ) 

p>2 
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defined on {— 1 , + 1 }^, where the term 

1 ^ 

HN,pi^) = 1)/2 H Sii-ip^h ■ ■ ■ ^ip ( 2 ) 

il ,...^ip=i 

is ealled a pure p-spin Hamiltonian, eoeffieients are standard Gaussian random variables 

independent for all p > 2 and all and eoeffieients {Yp)p >2 deerease fast enough, for 

example, Ep >2 2^7p < to ensure that the Hamiltonian is well defined when the sum ineludes 
infinitely many terms. An important feature of these models is that, if we denote by 

^h 2 = (3) 

i=i 

the overlap of two configurations 0^,0^ E { — 1, +1}^, then the covariance of the Gaussian process 
HN{(y) in ([T]) is a function of the overlap, 

E//^(ai)//A,(cj2)=A^^(Pi2), (4) 

where ^ (x) = Ep >2 Yp^^- this article we will only consider generic even p-spin models defined 
as follows. 

Definition. ( Generic even p-spin model) We will call the above mixed p-spin Hamiltonian generic 
if 7 p = 0 for odd p > 3 and linear span of functions for even p > 2 such that 7 , 0 is dense in 

C([0,1],||-||^). 

In other words, we assume that sufficiently many p-spin interaction terms are included in the 
Hamiltonian of the model. By the Miintz-Szasz theorem, the density condition is equivalent to 
'Lp>\P~^I{'Yp 7 ^ 0) = 00 . This will be needed to obtain the general form of the Ghirlanda-Guerra 
identities [|T4l [T5l that will be used crucially in the proof of our main result. 

When we consider two copies of the system, we can include arbitrary external fields, so let us 
consider a random vector and i.i.d. copies The distribution of can be 

arbitrary, and not necessarily centered. We only need some integrability condition and will assume 
that both coordinates have subgaussian tails. Then we consider the Hamiltonians 

i<N 

for j = 1,2. Given inverse temperature parameters /3i > 0 and /32 > 0, 

iv(^) ^ = (6) 

CT 

denotes the Gibbs measure of the 7 * system, where is called the partition function. 
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We will denote by {o,p) the veetors in ({ — 1, + !}'^)^ and by (■) the average with respect to 
(G^ X We will use the notation d = o/\/N and p = p/^/N, so that the overlap in ([3]) can 

be written as ■ d^. The overlap between a replica from Gj, and replica p ^ from Gl can be 
written as ■ p^. Our main result is the following. 

Theorem 1 7/'/3i 7 ^ J 82 then there exists a constant X ^ [~ 

lim E{{dGp^-xf) 

Moreover, X = ^ if either E(h^)^ = 0 or E(h^)^ = 0. 

A result of this nature was proved by Chen in ifTOl . but it required tuning the parameters (jp) in 
([U) between the two systems in a special way instead of changing the global inverse temperature 
parameter /3 as in TheoremfH which is the canonical form of chaos in temperature. Previous results 
concerned with another type of chaos, disorder chaos, were obtained by Chatterjee in [[61 (see ATI) 
in the case of no external field, and by Chen in |[8l in the presence of external field (see also ifTTI 
for a recent result that covers both cases). 

Although the statement of chaos in temperature in (|7]) looks very simple and does not refer 
to the properties of the two individual systems explicitly, the only known proof at the moment 
presented below passes through the entire Parisi ansatz and utilizes both ultrametricity/clustering of 
the overlaps and formula for the free energy. In fact, we will generalize the proof of ultrametricity 
in [|23l and obtain joint clustering for coupled systems at different temperatures in Theorem |9] 
below. Joint clustering can be viewed as a kind of symmetry between the two systems, because 
it implies that a neighbourhood inside one system coincides with the neighbourhood of the same 
size of any nearby point from the second system (this property is expressed in the equations (IMl) !. 
It will be proved using a new invariance property for coupled systems analogous to the invariance 
property from the proof of ultrametricity for one system in [|2Tl . As in [[23l . the new invariance 
property is based on the strong form of the Ghirlanda-Guerra identities [|T4l[T5ll . which itself was 
obtained in ll23 as a consequence of the Parisi formula for the free energy. In addition to yielding 
joint clustering, this invariance property possesses a certain built-in asymmetry due to the fact that 
two temperatures are different. This asymmetry turns out to be incompatible with the symmetry 
expressed by the joint clustering, under a certain assumption on the distributions of the overlaps 
within the two system which will be called uncoupled systems, and will allow us to rule out ‘large’ 
values of the cross-overlap. Another argument will rule out ‘intermediate’ values. 

In the complementary coupled case, the two systems conspire to hide this asymmetry on some 
non-trivial interval of possible values of the cross-overlap, in some sense. Somewhat miraculously, 
this case turns out to be perfectly suited for another well-known approach based on Guerra’s replica 
symmetry breaking interpolation ifT^ . proposed by Talagrand after his original proof of the Parisi 
formula in [[30ll . Although very natural, so far this approach has not been used successfully on 
its own to prove ultrametricity or chaos in temperature in any general case because of seemingly 
intractable technical difficulties, and the case of the coupled systems that arises in this paper is. 


1,1] such that 

= 0. (7) 
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perhaps, the only non-trivial known example where these obstacles spontaneously disappear. We 
emphasize that this step also relies on the validity of the Parisi formula for the free energy. 

Combining these two very different types of techniques will allow us to eliminate all ‘large’ 
and ‘intermediate’ values of the cross-overlap. The proof will then be concluded by appealing to 
the results of Chen in lITOll which handled ‘small’ values of the overlaps in full generality. 

The new invariance property will be proved and used in the infinite-volume limit N ^ For 
this purpose, we will first need to construct an object that will play the role of asymptotic Gibbs 
measures for coupled systems, which will be done in the next section. The construction will be 
based on a version of the Dovbysh-Sudakov representation [|T^ for coupled systems. 


2 Asymptotic Gibbs measures for coupled systems 


This section may be skipped at first reading and Theorem [2] can be used as a black box, because 
the techniques in its proof are not directly related to the rest of the paper. 

Consider a pair of random probability measures on { — 1, -|-1 that are not necessarily 

independent. The main example we have in mind are, of course, the Gibbs measures above. In this 
section, it will be convenient to denote replicas from both measures by but over different sets of 
indices, £ <0 and £ > 1, so we let ((7^}e<o be an i.i.d. sequence of replicas from Gj^ and 
be an i.i.d. sequence of replicas from Gl Let 


= 






( 8 ) 


be the array of all their overlaps. Suppose that converges in distributions under E(G]y x Gir- 
to some array R = Notice that this array is symmetric nonnegative-definite and also 

(partially) weakly exchangeable. 






(9) 


but not under all permutations of integers Z, but only those permutations that map positive integers 
into positive and non-positive into non-positive. It turns out that, as a result, the off-diagonal 
elements are again generated by a pair of random measures which in the thermodynamic limit live 
on a separable Hilbert space. This is the analogue of the Dovbysh-Sudakov representation IfT^ . 


Theorem 2 There exists a pair of random measures Gi and G 2 on a separable Hilbert space H 
(not necessarily independent) such that 

where (<7^)£<o is an i.i.d. sample from Gi and {(7^)£>i is an i.i.d. sample from G 2 . 


This will be a consequence of the following analogue of the Aldous-Hoover representation ifTlfTTll. 
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Consider a pair of random arrays 


{4,e')£f'>i {4/') 


£I'>\ 


( 10 ) 


that are separately exchangeable in the first coordinate and jointly exchangeable in the second 
coordinate, that is, 


for any permutations ;ri, ;r 2 , p of finitely many coordinates. Then the following holds. 


( 11 ) 


Theorem 3 If 071) holds then there exist two measurable functions C7i, <72 : [0,1]^ —)■ M such that 
the arrays in HUi can be generated in distribution by 


{4/') £,£'>l) = [{<^li^^4^n',4,£'))i,£'>V (c^2(w,Mivp,x|^,))^/>l), 

where all the arguments are i.i.d. uniform random variables on [0,1]. 


The proofs of both theorems will be a simple modification of the arguments in Austin 0, and are 
based on the following version of de Finetti’s theorem. Suppose that a random sequence {s£)i>i 
and random element Z take values in some complete separable metric spaces (S,^) and 
with the Borel (7-algebras, and suppose that 

{Z,{se)£>i) = {Z,{s^^£))^^^) ( 12 ) 


for any permutation n of finitely many coordinates. In this case, the almost sure limit 


V 



(13) 


in the space of probability measures on (5, y') (with the topology of weak convergence) is called 
the empirical measure of the sequence {si)g>i, if it exists. The following holds (see Proposition 
1.4, Corollary 1.5 and Corollary 1.6 from [HU). 

Theorem 4 If 472]) holds then the empirical measure 4771) exists almost surely and, conditionally 
on rj, the sequence {si)i>\ is i.i.d. with the distribution rj and independent of Z. 


The main part of the proof of Theorem [3] will be based on the following observation. Suppose that 
we have two random sequences of pairs {tl,s\)£>i and with coordinates in complete 

separable metric spaces, which are separately exchangeable. 


i>V i^£ ^^£)£>i) {^{^7t{£)^^7t{£))i>l^ {^p{£)^^p{£)) 


£>l 


(14) 
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for any permutations it and p of finitely many eoordinates. Consider the empirical measures 




1 




and 



Obviously, r/j is the marginal of rj^ on the first coordinate and, moreover, Pj is a measurable 
function of the sequence C = Let us denote 


ri = ( t ] 1 , t ] 2 ), ni = (ri},vf) andt = 


(15) 


The following holds. 

Lemma 1 Conditionally on (t])£>i and we can generate sequences {s\)£>\ and {sj)i>i 

in distribution as 

for some measurable functions fi and f 2 and Ltd. uniform random variables v, (jc])^>i and 
{x])g>i on [0,1]. 

Proof. First, let us note how to generate the empirical measures given the sequences 

t^ = {tl)g>i and Since Pj is the first marginal of rjf {tj)i>i are i.i.d. from pj'. This 

means that, if we consider the triple (p, T]i,t) defined in (fTSl) then the conditional distribution of t 
given (p, r/i) depends only on pi, 

P(t e ■ |r],T]i) =P(te ■ |r]i). 

This means that t and rj are independent given r/i and, therefore. 


e ■ \t,rii)=F{ri e ■ |?7i). 

On the other hand, rji is a function of t, so P(t] G ■ 11, T]i) = P(t] G ■ 11) and, thus, 

P(77 G ■ |t) =P(?7 G ■ Ipi). 

In other words, to generate T] given t, we can simply compute T]i and generate rj given rji. This 
means that, by the standard coding in terms of uniform random variables on [0,1] (see e.g. Lemma 
1.4 in [[251), we can generate rj = g(pi,v) in distribution as a function of rji and independent 
uniform random variable v on [0,1]. 

Since the sequences (t],5])£>i and (t|,5^)^>i are separately exchangeable, by Theorem [H 
conditionally on (r/^, 77 ^), the sequence (t],5|)^>i is i.i.d. from ri\ sequence (t|,5^)^>i is i.i.d. 
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from rj^, and these two sequenees are independent of each other. Therefore, given t and rj, we 
can simply generate sj from the conditional distribution ri '(sj G ■ 11/) independently over £ and j. 
Again, this means that we can generate sj — hj{r}j as a function of i.i.d. uniform random 

variables on [0,1]. Finally, recalling that rjj = v), we can write 

for some functions fj. This finishes the proof. □ 

Proof of Theorem |3l Let us for convenience index the arrays sj^,hy£> 1 and G Z instead of 
£' > 1. Let us denote 


A?/), X£> = and X = 

Since the sequence of columns ez is exchangeable and the empirical measure is a function of 
X, conditionally onX, the columns (Xf )f>i in the ‘right half’ of the array are i.i.d.. If we describe 
the distribution of one column X\ given X then we can generate all columns j independently 

from this distribution. Hence, our strategy will be to describe the distribution of Xi given X, and 
then combine it with the structure of the distribution of X. Both steps will use exchangeability with 
respect to permutations of rows, because so far we have only used exchangeability with respect to 
permutations of columns. Let us denote 


We want to describe the distribution of Xi = (4 \ given X = {Yl,Y^)g>i and we will use 

the fact that the sequences {Y^,s\ i)£>i and i)t>i separately exchangeable. By Lemma 

m conditionally on X = {Yl,Yf)£>i, {s\ j)^>i and {s\ i)i>i can be generated in distribution as 

where 7]i = (fil, fif) and rj^ is the empirical measure of and where instead of v and (xj) we 
wrote vi and (xj j) to emphasize the first column index 1. Since, conditionally on X, the columns 
(Xf )£/>! in the ‘right half’ of the array are i.i.d., we can generate 

4,£' ~ ^ 1 ’ Xp: 4, 

where and x^^^, are i.i.d. uniform random variables on [0,1]. Finally, we use that {Y^)£>\ and 
{Yf)£>\ are separately exchangeable. By Lemma[Il conditionally on T]i = (L/)^>i are 

i.i.d. from T]/ and independent of each other. Again, coding in terms of uniform random variables 
on [0,1], we can generate rji = h(w) as a function of a uniform random variable w on [0,1] and 
then generate 7/ = Yj(rii,uj) — Yj(h(w),uj) as functions of T]i and i.i.d. uniform random variables 
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on [0,1]. Plugging these into fj above gives 

for some funetions Ci and <72, whieh finishes the proof. □ 

Proof of Theorem|2l Sinee the array R is nonnegative-definite, eonditionally on R, we ean generate 
a Gaussian veetor g in with the eovarianee equal to R. Now, also eonditionally on R, let 
be independent eopies of g. For eaeh / > 1, let us denote the eoordinates of gi by g£^i for £ e Z. 
Then, sinee the array R = {Re/')e/>i satisfies (|9l) under all permutations of integers Z that map 
positive integers into positive and non-positive into non-positive, we have 

for any permutations ;ri, ;r 2 ,p of finitely many eoordinates. This is preeisely the property in (fTTl) . 
only here instead of using superseripts 1 and 2 we used different sets of subseripts £ > 1 and £ <0. 
By Theorem[3l there exist two measurable funetions 0 i ,02 '. [0, l]'^ —)■ M sueh that these arrays ean 
be generated in distribution by 

{^2{w,U£,Vi,X£j)) . 

By the strong law of large numbers (applied eonditionally on R), for any £ ^ £', 

1 " 

- 52 se,ige,i Ref 
^ 1=1 

almost surely as n —)■ oo. Similarly, by the strong law of large numbers (now applied eonditionally 
on w, and (m^)^<o), for any £ ^ £\ 

1 " 

- Y, {w, Ui, VuXgj) Of (w, , Vi.Xe^i) E'Oj (w, V, Xl) Of (w, , V, X 2 ) 

^ i=l 

almost surely, where E' denotes the expeetation with respeet to the random variables v,xi,X 2 . Here 
7 = 1 if £ > 1, j = 2 if £ < 0 and, similarly, for / and £'. Therefore, we showed that 

{Ref)if£: = {^'<yj{W:U£,V,Xl)Of{w,U£^,V,X2))^fgn (17) 

where 7 = 1 if ^ > l ,7 = 2 if£ < 0 and, similarly, for f and £'. If we denote 

ai(w,M,v) = Joi{WjUjVjX)dXj 02{w,U,v) = j02{w,U,V,x)dx 
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then (fTTl) can be rewritten as 


Notice that, for almost all w and u, the functions v -> Oj{w,u,v) are in // = L^([0, l],dv). There¬ 
fore, if we denote = o j{w,u^, ■), where 7 = 1 if £ > 1 , 7 = 2 if f < 0 , then (fT^ becomes 

It remains to observe that {g^)(,>\ is an i.i.d. sequence from the random measure Gi on H given 
by the image of the Lebesgue measure du on [0,1] by the map u 0 \{w,u, •) and (G^)e<o is an 
i.i.d. sequence from the random measure G 2 on H given by the image of the Lebesgue measure du 
on [0,1] by the map w —> a 2 (w, w, •). This finishes the proof. □ 


3 Invariance properties 

In this section, we will show that if one starts with the Gibbs measures Gt and Gl, considers 
an array R = {Ri/')t/'^z given by any subsequential limit in distribution of the overlap arrays 
in ([ 8 ]), and then considers a pair of random measures G\ and G 2 constructed in Theorem [2l then 
these measures will satisfy certain joint invariance properties, which will be consequences of the 
Ghirlanda-Guerra identities [fT4l[T5ll . 

The starting point is the strong form of the Ghirlanda-Guerra identities proved in [[22l . In the 
form of the concentration of Hamiltonian, these identities say that 

lim iE(|//^,^(cT)-E(//^,p(cT))|)=0 (20) 

A'—)-oo 7V 

whenever jp 7 ^ 0 in ([I]) and, similarly, 

lim 2 e(|H«,p(p)-E(H«,p(p))|) =0. (21) 

A'— 

In the rest of the paper we will denote the ratio of inverse temperature parameters by 

( 22 ) 

Let us consider a continuous bounded function of the overlaps 

■ G^' ,gG for < n 
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of n replicas ((7^,p^)^<„ from x Gj,. If we use (l20l) to write 

and then use Gaussian integration by parts on both sides (see e.g. Lemma 1.1 in [[25ll L we get 

E(d>(/3i(ai ■a”+i)^ + /32(a^ ■p”+^)^)> ^ - £/32E(d>(ai -pV) 

^£=1 

+ -/3iE(d>)E((di ■ d^)P) + - £ /3iE(d>(ai ■ d^)P) 

Tl fX /) /^ 


or, equivalently, 

E{^{{aGa"+^)P + -{aGp"+y)) ^ 1 £ -E{^{aGp^)P) (23) 

K" It £ _ Y ^ 

+ -E(4))E((ai ■ a^)P) + - £ E{^{a^ ■ a^)P). 
n n ^^2 

Similarly, using (l20l) . we can write 

E(d>((p^ ■ p"+^)^+ ^(p^ ■ £ K‘E(d>(p^ ■ d^)P) (24) 

^ t=i 

+ 1e(4.)E((p' +1 f E(<I.(P' ■p')'-). 

n n ^^2 

If we consider any limit of the array of all overlaps in distribution, in the limit, by Theorem [2l 
the overlaps can be generated from some random measure Gi x G 2 on where H is a separable 
Hilbert space. If we denote by (o'^,p^)^>i i.i.d. replicas from Gi x G 2 and if we continue to use 
the notation (■) for the average with respect to (Gi x G 2 )®°° then the above approximate identities 
will become exact identities 

E(d>((cji-a"+i)^ + -(ai-p"+i)^))=-£-E(4>(ai-pV> 

K" H £ _ ^ K" 

+ -E(d>)E((cji • o^)P) + - £ E(d>(cji ■ o^)P) 

Tl ft £ _2 


and 


E(4>((pi ■p"+i)^+ tf(pi ■ a"+^)P))=- £ KE(4>(pi ■ a^’) 

^ t=i 

+ iE(d>>E((pi ■ p^) + - £ E(4>(pi ■ p^)P), 
n n ^^2 
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where is now a continuous function of the Gram matrix of the overlaps 

■ p^' for < n 

of n replicas (a^,p^)^<„. Since we work with generic models and linear span of functions for 
even p>2 with ^ 0 is dense in C([0,1], || ■ ||oo), we get that 

E(d>(v/(o-^ ■ (7"+^) + -1/^(0-^ ■ =- -E(d>v/(o-^ ■ p^)) (25) 

K" fT £_ Y ^ 

+ -E(d>)E(v/(c7i • CT^)) + 2 £ E(d>v/(CT^ ■ a^)> 

Tl ^ _2 

and 

E(4>(v/(p^ ■ p"+^) + K‘V/(p^ • <7”+^))) =- £ k-E(4>v/(p^ • o^)) (26) 

'^£=1 

+ 1e(<i>)e( ik(p' ■ p") > +1 £ E(4.v'(P ‘ ■ p')> 

ft ft ^ _ 2 

for any continuous function t// on [—1,1], which is symmetric, 

V/(x) = V/(|x|) for X e [—1,1]. (27) 

Of course, the identities (1251) and (|2^ then hold for measurable bounded functions d> and \\f, if y/ 
is symmetric. Such identities first appeared in Chen, Panchenko BUl and later used by Chen in [fTOll . 
but here they will be used very differently, by way of the following invariance property. 

Let us denote a generic point in H by T, which could be either a or p. Given n > 1, we consider 
n bounded measurable functions /i, ...,/„ on [—1,1] that are symmetric, fj(x) = //(|x|), and let 


F(t, C7^..., ct'^) = /i (t-<7^) + .. . + /„(t ■ a'^). 


For 1 < f < n, we define 

Fg(T,a\...,a")=F(T,a\...,a")-fi(T-(7^)+E(fi(a^-a^)}. 

Similarly, let us consider n bounded measurable functions gi,... ,g„ symmetric on [—1,1] and let 


G(t,p\...,P") =gi(T-pl) + ...+g„(T-p") 


and, for 1 < £ < n, 


Gf(T,p2...,p") = G(T,p2...,p")-g£(T-p^)+E(g^(pl-p2)). 
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For i <n, we define 


De{o,p) = + kG{o,p\...,p’') 

+ ^F{p,a\...,a") + Ge{p,p\...,p") 

7C 

and, for £>n,we define Di{o,p) = D[o,p), where 

D{o,p) = F{o,a\. .., a") + KG{a,p\ ... ,p") 

+ \.F{p,o\...,o'^) + G{p,p\...,p^). 

fC 

In both eases, for simplieity of notation, we omit the dependenee on (a^,p^)^<„. The following 
holds. 


Theorem 5 Let ^ be a bounded measurable function of the overlaps R" of n replicas. Then, 




\ (expD(a,p))" 


(28) 


where the average (■)_ with respect to Gi x G 2 in the denominator is in {o,p) only for fixed 
(c^, p^)i<n, and the outside average {■) of the ratio is in (a^, p^)g<n- 


Proof. Without loss of generality, let us assume that |$| < 1 and suppose that |/^| < L and \g£\ < L 
for all £ < n for some large enough L. For t > 0, let us define 


'■=itDg{ofp^) 


\ {exptD{a,p)) 


(29) 


We will show that the Ghirlanda-Guerra identities (1251) and (|2^ imply that the funetion (p{t) is 
eonstant for all t > 0, proving the statement of the theorem, (p{0) = <p(l). For k> 1, let us denote 


'^n+k — 


"Y. 'Di(a',p‘) -{n + k- l)£>,+i(a"+‘,p"+‘). 


t=l 


Using that the average (■)_ is in (c,p) only, one ean eheek by induetion on k that 

\ (expfD((T,p))"^* / 

Next, we will show that (0) = 0. If we introduee the notation 

^ ~ , 

thend>' is a funetion of the overlaps of n + k—\ replieas {o\p^)g<n+k-i and = E(^>'n„+yt)- 


12 





On the other hand, ean be written as 

n .n+k—l 1 n+k—\ 

7=1 ^ ^=1 ^ £^ J ,£=1 

-(« + *-! )/;(c7”+‘ . <7J) - („ +1 - 1) i/,.(p"+‘ . (7>)) 

rC / 

It .n+k—l n+k—l 

+ £( £ K-^;(a^-p^')+ £ gXP^-P^)+E(,?;(p^-p^)> 

7=1 ^=1 

- (n + - 1 ■ p-^) - ^ - 1) '^^7(■ p^)) • 

Therefore, applying the Ghirlanda-Guerra identities (1251) or (|2^ to eaeh term 7 < n, we get that 

(p«(0)=E(d>U+fc)=0. 


If we denote M = L{2 + k + k then \D£\ < Mn and |n„_|_;t| < 2Mn. We ean then bound 


' '"111 > \ (exp<D(a,p)>y‘' 


i=l 

k 


i=l 


, n ^^/^expI:^^l^D7(cy^pO\ 

[Y[2M{n+t l)njE(^ (explD((T.p)>" /' 


where the equality in the seeond line follows from the faet that the denominator and d> depend 
only on (c^, p^)i<n and the average of the numerator in (c^, p^) for eaeh n < £ <n + k will eaneel 
exaetly one faetor in the denominator. Moreover, if we eonsider an arbitrary T > 0, using that 
iDil < Mn, the last ratio ean be bounded by exp(2A/r n^) for 0 <t <T and, therefore. 


max \ <exp(2MTn 

o<t<T' ^ 


2 ^{ n + k- 1 )! 

(n- 1 )! 


{2Mn) 


Sinee we proved above that (0) = 0 for all > 1, using Taylor’s expansion, we ean write 


k( 0 -<p(o)| < max 


I(^)I A / {n + k-iy. 


o<i<f k\ 


Y < exp( 2 Mrn" 


k\(n—\)\ 


■{2Mnt)\ 


Letting k^°° proves that (p{t) = (p(0) for 0 < t < {2Mn) ^. This implies that for any tQ < {2Mn) ^ 
we have (p^^^to) = 0 for all > 1 and, again, by Taylor’s expansion for tQ<t<T, 

|(p(7)-(p(7o)| < max 

to<s<t k\ 

< exp(2Mr Y) ' {2Mn{t - to)f. 
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Letting °° proves that (p{t) = (p{0) for 0 < t < 2{2Mn) ^ We ean proceed in the same fashion 
to prove this equality for all t < T and note that T was arbitrary. □ 

Next, consider a finite index set and let be some partition of H xH such that, for 

each a G ^/, the indicator/g^((7,p) =I{{o,p) £ Ba) is a measurable function of the overlaps i?" 
and 

0 0^,0 ■ p^,p- p -p^ for £< n. 

In other words, the sets in the partition are expressed in terms of some conditions on the scalar 
products between 0'",p,p V • • Let 

= Wai{(7\p^)e<„) = G{Ba) (30) 


be the weights of the sets in this partition with respect to the measure G = Gi x G 2 . Let us define 
a map T by 

W = {Wa)aes^^T{W) = 

Then the following holds. 


(/g„(<y,p)expD(g,p)). 

(expD(g,p))_ 


(31) 




Theorem 6 Let (p be a bounded measurable function of the overlaps i?" of n replicas and the 
weights W in ([3^. Then, 


\ (expD(g,p))_ 




(32) 


where the average (■)_ with respect to Gi x G 2 in the denominator is in (g,p) only for fixed 
(g^, p^)e<n, and the outside average {■) of the ratio is in (g^, p^)e<n- 


Proof. Let «« > 0 be some integers for ot G .2/ and let m = n + Eae^/^a- Let {Sa)aes!/ be any 
partition of {n + 1,... ,m} such that the cardinalities |5«| = ««• Consider a continuous function 
= d>(P") of the overlaps of n replicas and let 

4)' = 4>(i?") Y[ (Pa, where (pa = l{{(y^,p^) £ Ba^i £ Sa)- 

We will apply Theorem [5] to the function 4>', but since it now depends on m coordinates, we have 
to choose 2m bounded measurable functions /i,..., /m and gi,..., in the definition of D and Dg 
above. We will choose the functions /i,..., and gi,..., g„ to be arbitrary and we let 


fn+l • • • fm 8n+l • • ■ 8 m 0- (33) 

First of all, integrating out the coordinates (g^,p^)^>n, the left hand side of (1281) can be written as 

E(d>') =E(d>(i?”) n (Pa) =E($(i?") n W^-{io\p%<n)), (34) 

aes/ aesut 
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where W^’s were defined in (1^ . Let us now eompute the right hand side of (l28l) . By (1^ . the 
coordinates for £ > n are not present in all the functions Dg defined above and we will 

continue to write them as functions of (o',p) and {G^,p^)g<n only. Then, it is easy to see that the 
denominator on the right hand side of (l28l) is equal to (expD((7, p))“ and the sum in the exponent 
in the numerator equals Y!g=\ p^), where D and Dg depend implicitly on {G^,p^)g<n and are 
defined exactly as above Theorem |5l 

Since the function d> and denominator do not depend on (c^, p^)£>„, integrating the numerator 
in the coordinate (o’^,p^) for £ G 5^ produces a factor (/g^((7,p)expD(a,p))_. For each a e £/, 
we have |5«| = «« such coordinates and, therefore, the right hand side of (l28l) is equal to 

^/ d>(i?”)expE^^iD^(cy^,pO ^ / (/B«(g,p)expD(<y,p))_ y«\ 

\ (expD(c7,p))” (expZ)(c7,p))_ J / 

Comparing this with (1^ and recalling the notation (|3T]) proves (1^ for 

The general case then follows by approximation. First, we can approximate a continuous function 
(j) on [0, by polynomials to obtain (l3^ for products d>(i?")0(VF). This, of course, implies the 
result for continuous functions IT) and then for arbitrary bounded measurable functions. □ 

It will be convenient to rewrite the above invariance properties in the case when the functions (p 
and the partition depend on different number of replicas g\...,g" and p^,...,p"‘. If we suppose 
that m<n and sets the functions gm+i = ■■ ■ = gn = 0 then the invariance property can be rewritten 
as follow. First, as before we define 


F{t,g\...,G") =fi{x-G^) + ...+fn{x-G"). 


Also, as before, for 1 < £ < n we write 

Fg{x,G \..., C7") = F{x, g\..., g’^) -fg{x- G^) +E(/^(cj^ ■ Cj2) ) 


and, for £ > n + 1, we write 


=F(T,a^...,c7"). 

Since m <n,we have 

G(t,p\...,P'") =gi(T-pl)+...+g,„(T-p'") 


and, for I <i <m. 


GKt,p\...,p"^) =G(T,p\...,p™)-g^(T-p^) + E(g4pi-p2)). 
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For £ > m + 1, we now have 


G£(t,p\...,p'”) = G(T,p^...,p'"). 

We will deeouple the remaining notation as follows. Let us denote 

Di(a) =F(a,^J^...,^J") + K:G(a,p^...,p'"), (35) 

D^ip) = ^FiP,(y\---,(yl + Gip,p\...,p'") (36) 

7C 

and, for £ > 1, let us denote 

Dl{a)=Fi{a,o\...,o'^) + KGi{a,p\...,p’"), (37) 

D]{p) = ^F^(p,ct\...,c7")+G^(P,p\...,P“). (38) 

fC 

All of these functions now implicitly depend on . ,o" and p V • •; P™- Then 

D{a,p)=D\a)+D^{p), (39) 

D,(a,p)=Di(cj)+D2(p) (40) 


for all £ > 1. With this notation, 

(expD(c7,p))_ = {expD\a))_{expD'^{p)) 


and 

tD,{a\p^)=tDl{a^) + tDjiP^ 

£=i e=i £=i 

When (p{R^,W) and the partition {Ba)ae£^ do not depend on the coordinates p'”+V--;P”> the 
factors expD^(p^) for £ > m + 1 in the numerator in (l32l) can be integrated with respect to G 2 and 
cancelled out with the corresponding factors (expD^(p))_ in the denominator. Therefore, Theorem 
[6] can be rewritten as follow. 


Theorem 7 Let ^bea bounded measurable function of the overlaps R ofo ^,..., c" and p \ ? p”’ 
and the weights W in which are also defined in terms of the partition that depends only on 
these replicas. Then, 


\ (expDi(a))_(expD2(p))_ 


where the averages (■)_ in the denominator are with respect to G\ or G 2 . 


(41) 


16 



4 Joint clustering for large values of overlaps 


In this section, we will give first application of the invariance properties above and show that the 
overlaps within systems and between the two systems satisfy a joint clustering property for large 
values of the overlaps. 

First, let us mention one standard property of the generic models, namely, that the distributions 
of the absolute values of the overlaps \d^ and |p^ ■ p^| within the two system converge weakly 
to some measures pi and p 2 on [0,1], called the Parisi measures. This is a standard consequence of 
the Parisi formula for the free energy (see e.g. Talagrand [l29l . Theorem 14.11.6 in [|^ or Section 
3.7 in [|25l ). These measures also appear as unique minimizers in the Parisi formula, which will 
come up in Section|7] below. From now on we will denote by 

Cl = infsupp Pi, C 2 = infsuppp 2 (42) 

the smallest points in the support of the Parisi measures pi and p 2 . 

Let us consider n replicas .,o" from Gi and m replicas p^,. from G 2 . To simplify 
notation, let us denote them by 

for 1 < £ < n, = p^ for 1 < f < m. 


We will prove that any of these points can be ‘duplicated’ in a certain sense that will be explained 
below (see the first remark below Theorem [8]) and, for certainty, we will fix that point to be (7^. 
Then we will denote the duplicate point by and will represent 

Let us consider an overlap array 





l<£<£'<n+m 


and an array of some fixed parameters 


^ {‘^£,£') l<£<£'<n+m- 

Given e > 0, we will write x ~ a to denote that a — e < x < a-\- e and A to denote that 

~ f for all 1 < £ < / < n + m and, for simplicity of notation, we will keep the dependence 
of ~ on e implicit. Below, the matrix A will be used to describe a set of constraints such that the 
overlaps in can take values close to A, 

>0, (44) 

for a given e > 0. Let us consider the quantity 

a* =max(|ai,2|,...,|<3i,n+m|)- (45) 
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Recall that ci is the smallest point in the support of the Parisi measure /ii defined in (|4^ and 
consider any 

X > max(ci,a*). (46) 

Then the following duplication property holds. 

Theorem 8 (Duplication I) Given e > 0, if (dM hold then 

^ai,£/or2<£<n + m,|T^-T'’+'"+i| + >0. (47) 

In other words, if replicas and form some admissible configuration then, 

with positive probability, we can find a configuration with an additional point 7 "+'”+^, in this case 
o-^+i, which has (approximately) the same overlap as < 7 ^ with all other replicas and at the same 
time its overlap with is not too big, | cr^ • C 7 "+^ | <x + £. 

Remark. This result will be used in the following way. Suppose that the array A is in the support 
of the distribution of under E(Gi x G 2 )®"", which means that (l44l) holds for all e > 0. Then 
(1471) also holds for all e > 0. This means that the support of the distribution of with 

^n+m+i _ 0 -n+i under E(Gi x G 2 )®°° intersects the event in (l47l) for every e > 0 and, hence, it 
contains a point in the set 

{i?"+™=A,/-C7'^+i =ai,£for2<£<n + m, |c7i-c7”+^l <x}, (48) 

since the support is compact. Often when we say below that a point can be duplicated, it does 
not mean that we keep the same points and add another one, but that if a certain configuration is 
admissible (in the support of the overlaps) then a duplicated configuration is admissible and one 
can find possibly different points (or even for a different realization of the measures Gi and G 2 ) 
with such duplicated overlaps. 

Remark. Theorem [ 8 ] also holds if we would like to duplicate one of the points p \... ,p"\ let us 
say p^ but in this case we have to replace the condition by 

X > max (c2 ,b*), (49) 

where C 2 is the smallest point in the support of the Parisi measure ^2 and b* = max^^„^i |a£ |. 

We will start with the following simple result. 

Lemma 2 If p\ (A) > 0 then with probability one for Gi-almost all (7^ Gi(a^ : \ o^ ■ o^\ G A) >0. 
Of course, the same statement holds for the measure G 2 under the assumption P 2 (^) > 0- 
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Proof. We have a = fl\ (A*^) < 1. First of all, using the Ghirlanda-Guerra identities, 


E(/(|c7i • a^l e A^,2 < £ < n +1)) = E(/(|c7i • a^| G A^,2 < £ < n)/(|c7i ■ o-„+i| G A'^)) 

= - —^E(/(|c7i ■Oi\ G A‘^,2 < £ < n)), 

where (■) is now the average with respect to Gf Repeating the same computation, one can show 
by induction on n that this equals 


{n—\+a) ■ ■ ■ {1+a)a a(l+a)A a 
n\ “ n V "^2 


1 + 


n — 1 


^(i+fO^alogn ^ a{l+a) 
n 


Using the inequality 1 +a: < it is now easy to see that 

E(/(|CJ1-C7f| GAS2 <£<r + 1)) < 

If we rewrite the left hand side using Fubini’s theorem then, since a < 1, letting n —oo implies that 

limE [Gi{a^ : \a^ ■ a^\ eA^ydGi{a^)=0. 

«—^OO J 

This leads to contradiction if we assume that Gi(c7^ : ■ o^\ G A'^) = 1 with positive probability 

over the choice of Gi and the choice of which finishes the proof. □ 

Proof of Theorem HI We will prove (1471) by contradiction, so suppose that the left hand side is 
equal to zero. We will apply Theorem!^ with = {1,2} and the partition of H^, 

Bi = {{o,p):\a-o^\>x + £],B 2 = B\. 

By (|4^ . /ri([0,a: + e)) >0 and, by Lemma[2l the weight 

VF2 = (Gi X G2) {B2) = Gi (<7 ! Icr-CT^I <jc + £) >0 

with probability one. Since VFi = 1 — W 2 , we can find p < 1 and small 5 > 0 such that 

5 <E(^/(R"+™^A,Wi <p)y (50) 

Let us apply Theorem |7] with the above partition, the choice of 

(p{R,W)=l{R"+'^^A,Wi<p), (51) 


and the choice of functions /i ( 5 ) = t/(|5| > .v + e) for t > 0 and all other functions fj and gj equal 
to zero. Since on the event A} the overlaps |a^ • T^| < |ai ^1 + e < x + e for all £>2, the 
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sum in the numerator on the right hand side of (|4T]) will become 


n 171 

e=i i=\ 1=2 

= tE(/(|c7^ ■ a^l >x + £)) =: ty. 

Since the denominator on the right hand side of (l4TI) is greater or equal to 1, because > 0, 

the equations (l4TI) and (l50l) imply 


5 <E{|/(i?”+'”^A,(rf(iy))i < p) 

Recalling the definition of the map T{W) in (l3TI) . our choice of Bi and /i implies that 

Wie‘ 


(52) 


(7;(W^))i = 


Wief + 1 - 


(53) 


In the average (■) on the right hand side of (l52l) let us fix ..., and consider the average 
with respect to first. Clearly, on the event A} such average will be taken over the set 


f2(T^, 1 '’+"*) = [o : a ■ ^ ai^£ for 2 < i < n + m]. (54) 

Suppose that with positive probability over the choice of the measure Gi x G 2 and replicas , 
^n+m satisfying the constraints in A, i.e. ^ age' for 2 < £, / < n + m, we can find two points 

a' and o" in the support of Gi that belong to the set ,..., ) and such that | cr' ■ cr" | < x+e. 

This would then imply 

E(^/^R"+™ ^ ai^i for 2 < £ < n + m, |c7^ ■ a"+^| < x + ej ^ >0, (55) 

because for (a\ (7"+^) in a small neighborhood of (cr', o") the vector (t\ . ■ ■ ? a"+^) would 

belong to the event on the left hand side, 


_ ^?t+i ^ for 2 < £ < n + m, |( 7 ^ ■ < x + e}. 

Since we assumed that the left hand side of (1551) is equal to zero, we must have that, for almost all 
choices of the measure Gi x G 2 and replicas T^,..., t"+™ satisfying the constraints in A, any two 
points a', a" in the support of Gi that belong to the set f2(T^,..., t"+'") satisfy la' ■ C7"| > x + e. In 
other words, given a point a', we can not find a point a" in the support of Gi such that \o' ■ o"\ < 

X-\r £. 

Let us also recall that in (15^ we are averaging over that satisfy the condition (rf(VL))i < p. 
This means that if we fix any such o' in the support of Gi that satisfies this condition and belongs 
to the set (I54l) then the Gibbs average in o^ will be taken over the set 


Bi =Bi{o') = { 0 " : |a'-c7"| >x + e} 
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of measure Wi = V7i(c7') 
inequality 


Gi(5i(c7 ')) that satisfies {Tt{W))i < p. It is easy to eheek that the 


(7;W)i 


Wie^ 

Wie^ + l-Wi 


<P 


implies that Vki < (1 — p) ^ This means that the average on the right hand side of (l52l) over 
for fixed T^,..., is bounded by (1 — and, thus, for t > 0, 


0 < 5 < (r,(lT))i < < (1 - 

Sinee x > ci by the assumption (1^ . 


1 - 7 = E(/(|c 7^ ■ (7^1 < x + e)) = Pi ([0,x + e)) > 0, 


and letting t —)■ +oo we arrive at eontradietion. □ 

Using the above duplieation property, we will now prove a joint elustering property for the absolute 
values of the overlaps from the measures Gi and G 2 . Let us eonsider 


q > max(ci,C 2 ). 


(56) 


Then the following holds. 

Theorem 9 (Clustering) For q that satisfies we have 

><?}n{|T^-T3| ><?} c {\T^-T^\>q} (57) 

with probability one over choice of any three replicas (which could be o’s from Gi or 

p’s from G 2 ). 

Proof. The proof is by eontradietion. Suppose that (1571) is violated, in whieh ease there exist 

max(ci,C2) <a<b<c 

sueh that the veetor (c,b,a) is in the support of (|t^ ■ T^|, |t^ ■ T^|, |t^ ■ T^|). Then, there exists a 
partieular ehoiee of ei,e 2 ,e 3 G {— 1 , + 1 } sueh that (Cic, £ 2 ^, £ 30 ) is in the support of the array of 
overlaps (t^ ■ T^, ■ T^, ■ T^). 

Using Theorem [ 8 ] repeatedly with the ehoiee of x = c, we ean duplieate points and (in the 
sense deseribed in the remark below Theorem[ 8 ]) as many times as we like by preserving the sealar 
produets with other points and at the same time making sure that no two points have sealar produet 
in absolute value exeeeding c. This means that, for any n > 1, there exist points T^, (t^^)^<„ and 
i'^j)e<n ill our Hilbert spaee H sueh that 

t/ ■ = £2^, = £36!, t/ ■ t| = £iC, I t/ ■ t], I < C, I I < C 
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for all < n. Let us consider the barycenters of these sets of duplicate points, 




e=i 


Then = Cic, = £ 2 ^ and x^ ■ x^ = e^a and 


;?! ^3 _ 


;r2 . ^3 _ 


|;rh|2_ ^ V||t2||2, ^ V W W + 

1^11 V- ,,2 


i<n 




Therefore, we can write 

||t‘ -eiT^f = lljlf + ||t 2||2 _ 2^1 Jl , j2 < 2(1^^ 

n 

which implies that \e 2 b — £i£ 3 a| = |t^ • (t^ — £iT^) | < Letting n ^ oq yields e 2 b = fiifisa, 

which contradicts the assumption 0 < a < b. □ 


5 Large values of the overlap 

Let /ii and 112 be the Parisi measures and let us define 

< 2 'o = inf{t : /3ijUi ([0,t)) 7 ^/ 32 M 2 ([ 0 ,t))}. (58) 

From now on, let us for certainty suppose that 

Cl < C2, (59) 

where ci and C 2 are the smallest points in the support of jii and 112 defined in (l42l) . Let us recall that, 
by Theorem 4 in Chen [fTOl . if E(h2)^ = 0 then cj = 0. On the other hand, by Theorem 14.12.1 in 
Talagrand ll32l . if E(/?2)^ > 0 then cj > 0. We will now show that the overlap between two systems 
can not take large values. 

Theorem 10 /fil5^ and ^l59l) hold then 

E(/(|( 7 ^-p^l > max(c 2 ,<?o))) = 0- ( 60 ) 

Proof. Suppose that (l60l) is violated, 

E(/(|a^ -p^l > max(c 2 ,<?o))) > 0. 

Then, by the definition (l58l) . we can find q> qo such that q> 02 and such that 
E(/(|c7^-P^| >q)) >0 and /3ipi([0,^)) ^/32P2([0,^)). 
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Indeed, if > C 2 then we ean find sueh q right above q^, otherwise, if q^ < C 2 then we ean 
take q = C 2 sinee, in this ease, /l2([0,C2)) = 0 and /ii([0,C2)) > 0. By Theorem |9l on the event 
{|c7^ -p^l > ^}, the following equalities in the support of Gi and G2 hold, 

B = {O : |(7-C7^|><2'} = {C7 : |c7-p^|><5r}, 

B'= {p : |p-c7i| >^} = {p : |p-pi| (61) 


This is the symmetry property that was mentioned in the introduetion. Let us denote Wi = Gi (B) 
and W 2 = G 2 {B'). Let us use Theorem [5] for n = I and 


d> = /(|ai-pi| >^). 


First, we apply Theorem [5] with gi = 0 and fi{x) = tl{\x\ > q). Sinee /i(o'^ -p^) = t on the event 
{|<7^ -p^l > q}, we get 


0<E(/(|a^ 


■P 


‘|>«))=e//(|<7‘-p‘|>«) 


exp[tE{I{\o^ ■o^\>q))+t/K) \ 

{Wie^ + 1 - ITi) (1^2^'/'" + I-W 2 ) /' 


Next, we apply Theorem |5] with /i = 0 and gi{x) = sl{\x\ >q). In this ease, we get 


^ \ VI '-'^nw^^Ks^i_^2A(W2e^ + l-W2) / 


If we take t = ks > 0, the right hand sides above ean be equal only if 


K‘j'E{/(|c7^ ■ a^\ >q)+s = 5E(/(|p^ • p^l >q) + Ks 


or, equivalently, E(/(|p^ ■ p^| < q) = /fE(/(|a^ • o^\ < q). This ean be written as /3ipi([0,(?)) = 
/32P2([0, <?)), whieh eontradiets our ehoiee of q above. Asymmetry of the invarianee property with 
respeet to /3i, J82 turns out to be ineompatible with the symmetry expressed in (IMl) . □ 


6 Intermediate values: uncoupled case 

In this seetion, we eontinue to assume (l59l) and we will also assume that 

<?o < C2, (62) 

where qo was defined in (15^ . We will eall this uncoupled case, beeause this means that either 
Cl < C 2 or if Cl = C2 then the measures pi and p2 are immediately different to the right of ci = C2. 
We will treat the coupled case later by very different methods, i.e. when ci = C2 and the measures 
Pi and P2 are equal on some non-trivial interval [ci,(?o)- 

First of all, if (l62l) holds and if E(/?^)^ = 0 then, as we mentioned above, C2 = 0 by Theorem 
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4 in Chen [fTOll and, therefore, Theorem [TO] implies that the overlap ean not take values other than 
zero asymptotieally. This means that in the rest of this seetion we ean assume that > 0 and 

C 2 > 0. Moreover, Theorem 14.12.1 in Talagrand [1^ also gives that C 2 > 0 is the smallest point 
in the support of the distribution of p ^ and not only |p ^ ■ p^|, i.e. the overlap is strietly positive 
for the seeond system. 

Theorem 11 holds then 


E(/((7^ .pi = -p^)) = 1. 


(63) 


Proof. Suppose there exist jc and qi ^ q 2 sueh that {qi,q 2 ,x) is in the support of 


(C7i-p\c7i-p2,pi-p2) 


By TheoremfTO we must have \qi \:\q 2 \ < C 2 - By the eomment above, x>C2>0. Using Theorem[8] 
repeatedly, we ean duplieate points p ^ and p^ (in the sense deseribed in the remark below Theorem 
[8]) as many times as we like. This means that, for any n > I, there exist points (p/)^<„ and 
(p|)^<« in nur Hilbert spaee H sueh that 

p£-(y^ = qi,Pr(y^ = d2,Prp£' ^ulpi-p^l <x,\pj-p{,\ <x 


for all f < n. Let us consider the barycenters of these sets of duplicate points, 

1 IT 1 ^ 

p'-zIpIp-zIpI 


' £=l 


' £=l 


Then p^ ■ p^ = x, p^ ■ = qi and p^ ■ = q 2 and 




2 ^1 


llPl^ = 3 E llP/lf + i E Pi ■ Pi £ 


£<n 


£^£' 


Therefore, we ean write 

IIP‘-P¥ = IIP'f+IIP¥-2P''P^<^ii^. 

n 

which implies that 

\qi-q 2 \ = |CT^ ■ (p^ -p^)| < 

Letting n —)■ co eontradiets the assumption that <?i 7 ^ <? 2 - C 

Next, we will prove another duplieation property. As before, let us eonsider n replieas cji,..., c" 
from G\ and m replieas p ^,..., p™ from G 2 . To simplify notation, let us denote them by 

for 1 < £ < n, = p^ for 1 < f < m. 


24 




We will prove that <7^ ean be duplieated in the sense very similar to the first duplieation property in 
Theorem [8l only here the overlaps between p’s and cr’s will play a seeondary role, due to Theorem 
Let us eonsider an overlap array 

^ “ V ‘'1 l<£<£'<n+m 

and an array of some fixed parameters 

^ = {<^£,£') l<£<£’<n+m- 

As above, given e > 0, we will writex ~ a to denote that a — £ <x < a + e andA to denote 
the same approximate equality element-wise. We will assume that 

E(/(i?"+™^A)) >0 (65) 

for all e > 0, i.e. A is in the support of the distribution of Let us eonsider the quantity 

a* =max(|ai, 2 |,...>i,„|) (66) 

if n > 2 and set a* = ci ifn= 1. The differenee with the duplieation property in Theorem [8] above 
is that now a* is determined only by the overlaps between and other c’s and we ignore the 
overlaps for f > n -|- 1 between and p’s. Consider the event 

A+ = • p^ «!,«+£ for 1 < f < m, ■ (7^ ^ ai^i for 2 < f < n, |a^ ■ \ < a* -t-e|. 

The following duplieation property holds. 

Theorem 12 (Duplication II) If^62\i holds and if the array A satisfies fl631) then 

E(/({i?"^A}nA+)) >0 (67) 


for all small enough e > 0. 

Again, this ean be reinterpreted by saying that if A is in the support of that the support of the 
overlaps that inelude additional repliea (7"+^ eontains a points in 

[R" = a, ■ p^ = ai^„+£ for 1 < f = ai^£ for 2 < £ < n, |(7^ • \ <a*]. (68) 

Proof of Theorem [I2l We will prove (1671) by eontradietion, so suppose that the left hand side is 
equal to zero. We will apply Theorem!^ with ^ = {1,2} and the partition of H^, 

Bi = {(<7,p) : I(7- (7^1 > a* + e}, B 2 = Bf 
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Since a* > ci, jUi ([0, a* + e)) >0 and, by Lemma[2l the weight 

W 2 = {GixG 2 ){B 2 ) = Gi{o : |a• (7^| < a* + e) > 0 
with probability one. Therefore, we ean find p < \ and small 5 > 0 sueh that 

5 <p)y (69) 

Let us apply Theorem |7] with the above partition, the ehoiee of 


(p{R,W) =/(i?"+'”^A,lTi < p), 


(70) 


and the ehoiee of funetions /i (jc) = |ji;| > a* + e) for t > 0 and all other funetions fj and gj equal 

to zero. First of all, reealling the definition of the map T{W) in (l3TI) . our ehoiee of the set Bi and 
funetions // and gj implies that 




WW 

Wie^ + 1 - ITi ■ 


(71) 


On the events?"’'"'" ^ A, we have < \a\^(\ + e<a* + efor2<£<n and f\{o^ ■ o^) = 0. 

Therefore, the exponent in the numerator in (|4T]) equals 


exptE(/ 


m ^ 

■ o^\ > a* +e)) exp ^ —7(|o'^ • p^| > a* +e). 
t=\ ^ 


By Theorem [m we have -o^ = p^ ■ for all f, so this is equal to 

exptE(/(|(7^ ■ (7^1 > a* +e)) expm—/(|(7^ ■ p^\ > a* +e). 

K* 

The denominator in (|4T]) equals 

1 / t \ 171 

(exp/i(a-(7^))”(exp-/i(p-a^))“ = (lTie^ +1-lTi)”(exp-/(|(7^-p] >a*+e)) . 

K* \ K* / _ 

The behaviour of the seeond faetor in the last two equations will depend on whether 


(i) \ai,n+i\<a*, 

(ii) |ay„+i|>aL 

In the ease (i), on the event A, we have |p^ ■ | < |ay„+i | + e < a* + e and, therefore, 

exp—/(I(7^ -p^l > a* + e) = 1. 

K* 

By Theorem [m on the event A, we have p • <7^ = p^ ■ (7^ and, henee, |p • <7^ | < a* + £ for 
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all p in the support of G 2 and, therefore, 



In the ease (ii), we ean suppose without loss of generality that e > 0 is small enough, so that 
|< 2 i,«+i| — £ > a* +£. Then, on the event ^A, \p^ ■ o^\ > |ap„+i | — £ > a* + £ and 

expm—/(IcT^ • p^l >a*+£) = expm—. 

Again, by Theorem fTTl on the event ^ A, p ■ and, henee, |p • <7^ | > a* + £ for 

all p in the support of G 2 and, therefore, 

(|^exp—/(|(7 -pi > a*+£)y =expm—. 

In both oases, we see that these terms in the numerator and denominator oanoel out. Therefore, if 
we denote 7 = E(/(|o'^ ■ a^\ > a* +£)), the equations (l4T]) and (l69l) imply 

5 <E(^/(i?"+™^A,(rf(lT))i < p)e^^y (72) 

The rest of the argument is identioal to the proof of Theorem [T^ and shows that (17^ leads to 
eontradiotion. □ 

Using the above duplioation property, we ean now prove the following. 

Theorem 13 /CildTI) holds then 


E(/(|cji-pi| = |a 2 .pi|)) = l. (73) 

Proof. If not, then we ean find non-negative x and q 2 sueh that {qi,q 2 ,x) is in the support of 

{\a^ ■p\\o^-p^l\a^ ■a^\). 

This means that for ehoiee of £1, £2, £3 G { — 1 , -|-I}, (£1^1, £2<?2, £3x) is in the support of 

{a^.p\a^.p\a^.a^). 

Using Theorem [T^ repeatedly, one ean show that there exist points P\ {0l),<n and in our 

Hilbert spaee H sueh that 

a/ ■ p^ = £i<2'i, of ■ p^ = £2^2, of ■ of = £3X, |of ■ of I < X, |of ■ of | < x 
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for all < n. Consider the baryeenters, 



Then = e^x, = £iqi and cr^ ■ = £ 2(^2 and 



n-\-n{n— \)x 


Therefore, we ean write 




n 


whieh implies that \e\q\ — eiE^qj 
assumption qi 7 ^ ^ 2 - 


pi ■ (cji -£3^2)1 < In 1 /^. Letting n —)■ 00 contradiets the 


□ 


Finally, we get the following. 
Theorem 14 holds then 


E(/(|cTi-pi|>x/?IFi))=0. 


(74) 


Proof. Suppose that q is in the support of ■ pi |. By Theorem [TOl and assumption (1^ . q < c^. 
This means that we can apply Theorem!^ to pi with x = C 2 , since a* = ^ < C 2 in (1451) . so we can 
duplicate pi repeatedly and find cji and (p^)f<„ such that 

Icjl-p^l =^,|p^-p^'| <C2 

for all f< n. Since C 2 is the smallest point in the support of p 2 j this means that 

\(^ -p \ =q^p -p \ = C 2 

for all f< n. Again, a more precise statement is that there exist such values in the support of the 
overlaps of and {p^)e<n- Next, we apply Theorem O with a* = ci to duplicate repeatedly 
and find {G^)e<n and {p^)e<n such that 
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for all < n (i.e. such values are in the support of the eorresponding overlaps). Let 


^ n ^ 


Then we have p ■ o = q. 




<! n-\-n{n — \)c\ 


£<n 




and 


2 < J_y || p '||2 + J_£ | p «. p ''|<! L +"(" ‘>‘■2 

£<n 




Using the Cauehy-Sehwarz inequality, q = p-o < ||p||||o'||, and using the above bounds and letting 
n^oo shows that q < ■^c\C 2 - □ 


7 Intermediate values: coupled case 

In this seetion, we will eonsider the eomplementary ease when 

<?o > C 2 , (75) 

where was defined in (l58]) . This means that c — ci — C 2 and the measures pi and p 2 are equal 
on some non-trivial interval, 

PiPi([0,t]) = P2P2([0,t]) forallt G [c,^o)- (76) 

We will now go baek to the setting of the finite size system on { —1, + 1}^ and show that the 
following holds. 

Theorem 15 Suppose that flTJI) holds. Then, for any £ > 0 there exists d > 0 such that 

lim E(/(|a^ -p^l e [c + e,< 5 ro + 5])\ = 0. (77) 

Combining this with Theorem[T0l whieh holds for any subsequential limit, we get the following. 
Theorem 16 Suppose that f[75l) holds. Then, for any e > 0, 

lim E//(|ai-pi| >c + e)\ =0. (78) 

To prove Theorem [T5l we will use Talagrand’s analogue of Guerra’s repliea symmetry breaking 
bound [|T^ for eoupled system from Theorem 15.7.3 in 1(3^ . First of all, let us reeall the Paris! 
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formula for the free energy for one system, 



-^E log ^ exp /3; (cy) + £ h\ o?). 

o ^ i=l ^ 


Both the Paris! formula and Talagrand-Guerra upper bound can be constructed explicitly, and it is 
well known that these constructions satisfy certain partial differential equations, as explained, for 
example, in Section 14.7 in [[^ (see ifT^ for a detailed study of the general non-discrete case). 
Since our arguments below will utilize only the properties expressed by these differential equations 
(in addition to some well known properties), we will not repeat the explicit constructions here and 
will only recall the corresponding descriptions in terms of differential equations. 

We will abuse notation slightly and write \Xj{q) = /i;([0, <?]). Let us consider functions ^j{q,x) 
for (7 G [0,1] and x G M that are solutions of 


dq 


r'to) (S-t’i 

2 V dx^ 


\-^j{q) 


V dx 


where ^ (q) was defined in ([4]), with the boundary condition at ^ = 1 given by 


(79) 


d>y(l,x) = \ogch{l5j{hJ +x)). 


(80) 


Let us denote 6{q) = q^'{q) — ^ (q) and define a functional 

^ji^j)=E^ji0,0)-y^'l5f^j{q)e'{q)dq, (81) 

where the expectation is in the external field hL Then the Paris! formula [|2^ iTTlI proved by 
Talagrand in [[^ (for another proof, see Il24l f gives that 


lim F^ = inf'^(At;). (82) 

A'— jj. j 

It was proved by Auffinger and Chen [l3]| that the functional ^(/ij) is strictly convex and the 
minimizer is unique (see ifTSl for another proof). For generic models, this minimizer is precisely 
the limit of the distribution of the overlaps within systems at the same temperature (see [|29l . 
Theorem 14.11.6 in [[^ or Section 3.7 in ll^ ). so we will continue to denote it by /iy. 

Now, let us consider any m G [—1,1] and consider the free energy of a coupled system with the 
overlap constrained to be equal to u, 

Fn{u) = ^Elog ^ exp/3i a/j exp^ 2 (^^iv(p) + (83) 

dp = U 1=1 !=1 

From now on, we will assume that w G [0,1], because for negative u, making the change of variables 
p —)■ —p simply changes (hl^hf) into and our arguments will not depend on the choice 
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of the distribution of h^). 

We will give an upper bound on ([83]) in Proposition [T| below, which is just a rephrasing of 
Proposition 5.1 in Talagrand 1(311 with A = 0 there and = v G [0,1]. We will rewrite this bound 
for general instead of only discrete parameters using definitions in terms of differential equations, 
as in (TTOl) . This last parameter v will represent a value of the overlap up to which the parameters in 
Talagrand’s bound are completely correlated, and after which they are independent. We will take 
the functions in that bound to be ^jjiq) = I5jl5y^{q), and we will choose parameters (ng) 
there in such a way that for the overlaps greater than v they correspond to the c.d.f.s jli and /I 2 
of their individual independent systems, and for values of the overlaps less than or equal to v they 
correspond to some new (improper) c.d.f. fl, which can be arbitrary as long as 

jU(v) <min(/ii(v),/i 2 (v)). (84) 


Let us consider a function d>v(<?, x) for q G [0, v] and .v G M which is the solution of 


dq 


2 V dx^ 



with the boundary condition at ^ = v given by 


(85) 


d>v(v,x) = d>i(v,A:)+d> 2 (v,.r). 


( 86 ) 


Let us define a functional 

,^(v,jU) =E4>v(0,0)-^ / {Pl+P2fll{q)d'{q)dq-Y,\l ^]li-j{q)Q'{q)dq +^{u,v), (87) 

^ 70 ^ Jv 

where the expectation is in the external fields {h\h^) and the last term is given by 

A(m,v) =/3i/32(<^(m)-m<^'(v) + 0(v)). (88) 

Note that for v = u, A(m, v) = 0. Talagrand’s upper bound can be written as follows. 

Proposition 1 For any w, v G [0,1], ffdS?!) is satisfied then 

T)vW<^(v,m). (89) 

From now on, we will make the following canonical choice of parameters. We will always take 

V < ^ 0 , (90) 

where q^ was defined in (15^ . which means that iox q<v we have 

PiFiid) = PiFiid)- (91) 
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Let us introduce the notation 


(92) 


g _ /^1 1 g _ 

/3i+j82’ P 1 +P 2 

and from now on set the function /r (q) to be 

ll{q):=Xlli{q)^{l-X)^2{q) (93) 

for ^ < V, which clearly satisfies (1841) . With this choice, 

(/3i +[52)^iJ.{q) = (/3i +/32)/3 i^i(<2') = [5iiJ.i{q) +/32At2(<?) 
for q <v < qo, where we used (IMl) . Therefore, (1^ becomes 

=E^v(0,0)-^ I5jllj{q)e'{q)dq + A{u,v). (94) 

For discrete choices of parameters as in [|3T]| . one can easily check by looking at the explicit 
representation of these bounds and using Holder’s inequality that this choice of /i implies that 

E4>v(0,0) < Ed>i(0,0) +E4)2(0,0). 

Our goal will be to show this inequality for arbitrary jii and 112 and, moreover, to show that it is 
strict over a certain range of values of v. 

Theorem 17 Suppose that holds. Then, for any £ > 0 there exists 5' > 0 such that 

Ed>v(0,0) <E$i(0,0)+Ed>2(0,0)-5' (95) 


for all V G [c + £, ^o)- 

This immediately implies the following. 

Theorem 18 Suppose that ^76\) holds. Then, for any e > 0 there exist 5 > 0 and 5^ > 0 such that 

2 

FN{u)<Y,<^j[Pj)-S' (96) 

7=1 

for all u E [c + £, (?o + 5]. 

In a completely standard way. Theorem [15] follows from this by classical Gaussian concentration 
inequalities (see Section 15.7 in ll32ll f. 
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Proof of Theorem HSl For m G [c + e,( 2 'o), let us take v = u. Then Proposition [H (|94|) and (l95l) 
imply (|9^ . For uE [(?o,<?o + 5), let us take v = qo —5. Then Proposition [H (|94|) and (l95l) imply 

2 

pNiu) < Y, + A{qo-d,qo + d). 

i=i 


Taking d small enough we ean ensure that A(qQ — d,qQ + d) < d' j2, so redefining 5' finishes the 
proof. □ 

The next two results will be proved for a fixed {h^ ,h^). We will begin the proof of Theorem [T7] 
with the following result. Let us define 

= (97) 

Pj 


Then the following holds. 


Theorem 19 If Pi ^ jfi then, for any fixed and any q G [0,1], the functions •) and 

'P 2 (?, •) t^re not identically equal. 


Proof. Sinee satisfy (1791) . 'Pj satisfy 




3'¥j-,2 


with the boundary eondition a.iq = \ given by 


1 


= j^logch(/3j(fij+x)). 


5‘t' 


Let us eonsider Xf/j = and differentiating the above equation in x, we see that 


with the boundary eondition dXq=l given by 


(98) 


(99) 


( 100 ) 


V/j(l,x) =th(/3j(/?j + v)). (101) 

It is well known that \xifj{q,x) \ < 1 and all partial derivatives of \i/j(q,x) in x are bounded (see 
e.g. Propositions 1 and 2 in O). Therefore, we ean eonsider the strong solution of the stoehastie 
differential equation (see e.g. Proposition 8.2.9 in EOl l 

dXj{t) = ^''{t)Pj^j{t)\ifj{t,Xj{t))dt + ^''{tyl^dB{t) (102) 
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withXj(^) = X, where (5(f))f>o is a standard Brownian motion. Using Ito’s formula and (1 1001) . 

=^"(ty/^^dB(t). 

ox 

Integrating between q and 1 and taking expeetations gives 

V/j(^,x) =Ev/;(l,XXl)) =Eth(/3,(/i,- + X,(l))). (103) 

Let us integrate (11021) between q and 1, 

Jq Jq 

The first integral is bounded in absolute values by a sinee < 1, and the seeond term 

has Gaussian distribution with the varianee dt = ^'(1) — ^\q). Therefore, 

P(^|X;(l)-x| > r) <e-^^ 

for large y (independent of x), where a is some eonstant that depends on /3i, P 2 and ^. Suppose for 
eertainty that /3i < ^ 2 - First of all, using (11031) and the faet that 1 — th(x) is deereasing, 

\-\i/i{q,x) = l-Eth(/3i(/zi+Xi(l))) 

> (1 -th(/3i(/zi +X + r))P(Xi(l) -X < 7 ) 

>(l-th(ft(A|+.x+r))(l-e-‘'»"). 

Similarly, 

l-\ff 2 {q,x) = 1 -Eth{l52{h2+X2{l))) 

< ( 1 -th(/ 32 (/i 2 +x- 7 )) +P(X 2 (l)-Ji;< - 7 ) 

< ( 1 -th(/32(/i2+x-7)) 

Now, let us take 7 = ex, where e > 0 is sueh that / 32 ( 1 — e) > /3i ( 1 + e) . Then, as x — )■ + 0 °, 
{l-th(MI'2 + x-y])+e-‘-^ <{l-th(P,{h,+x + y]){l-e-°^), 
sinee this is equivalent to 

( 1 -th(j 82 /i 2 + j 82 (l-e)x))< ( 1 -th(/3i/q+/3i(l+ e)x ))(1 
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and because the two sides have very different asymptotics as x ^ +oo and their ratio goes to zero, 
using 1 — th(ji;) ~ 2e^^. This shows that, for any q, the functions •) and V/ 2 (<?, •) are not 
identically equal, which finishes the proof. □ 

Recall the definition of A in (l92l) and define 




1 

X 


d>i(^,x), ^2{q,x) 


1 

l-A 


d> 2 (^,x). 


If we recall the definition of jl in (|9^ . one can easily check that 


(104) 


dq 


2 


V dx^ 




dx / 



(105) 


which is the same equation (1851) satisfied by 4 >v((?,jc) and, moreover, the boundary condition (f 8 ^ 
can be rewritten as 

4>v(v,jc) = X^\(y,x) + (1 - A)<J> 2 (v,x). (106) 

Theorem[T9lcan be expressed by saying that the functions <I>i {q, ■) and 4 > 2 (<?, •) are not identically 
equal for any q. As a consequence, we will show the following. 


Theorem 20 Ifv G [c + e, (^tq) then, for any fixed {h^ ,h^) and q <v, we have strict inequality 


d>v(<?,x) <X^i{q,x) + {\-X)^2{q-:X). 


(107) 


First, let us show how this implies Theorem [T71 

Proof of Theorem UTI Let vq := c + e and consider any v G (c + e, qf), so that vq < v. First of all, 
(11071) implies that 


4>v(vo,x) < A4 >i(vo,x) + (1-A)$2(voa) =^vo(voa)- 

Both d>v(^,x) and d>vo(^,x) satisfy the same equation ([85]) . so d>v(^,x) < d>vo(^,x) for all q < vq, 
because this equation preserves monotonicity with respect to the boundary conditions. This is 
because the case of general /i can be approximated by step functions (see e.g. Theorem 14.11.2 
in [l32l0 and, on any interval where /i is constant, exp/r4>v satisfies the heat equation. Using (1107!) 
again implies 

^v(0,0) < (0,0) < A4>i (0,0) + (1 - A )$2(0,0) = d>i (0,0) + d>2(0,0). 

This holds for any fixed {h^ ,h^) and averaging in (fi\fi^) yields 

Ed>v(0,0) < E$vo(0,0) < ^E4 )i( 0,0) + (1 - A)E$2(0,0) = E4)i(0,0)+E$2(0,0). 

The strict inequality is uniform over v G [c + £, qf) , which finishes the proof. □ 
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It remains to prove Theorem [20l Our proof will be based on the variational representation of 
solutions of the equation (l85l) in Theorem 3 in Auffinger, Chen |[3l, whieh we now reeall. 

We will slightly modify their statement to replaee the interval [0,1] by [0,v]. As before, let 
{B{q))q>Q be a standard Brownian motion and, for 0 < 5 < t < v, let ^[s,t] be the spaee of all 
progressively measurable proeesses u on [5,t] with respeet to the filtration generated by B{q) sueh 
that ||m||oo < L for some arbitrary large enough eonstant L. In [O, L was ehosen to be 1 and it eould 
not be smaller that 1, but it will be eonvenient not to impose this artifieial restrietion here. Suppose 
that / is a solution of (l85l) . for example, / = d>v, ‘l>i or <1>2. For any x G M and w G ^[ 5 , t], define 

F^'\u,x) = ¥.{C'\u,x)-V'\u)), (108) 

where 

C^\u,x) =f(^t,x + J^ ^”{q)[l{q)u{q)dq + ^''{qy/^dB{q)^ , 

= ^''{q)B{q)u{dYdq. (109) 

With this notation, the following holds (Theorem 3 in lf3l'). 

Proposition 2 For any 0 < s < t <v, 

f{s,x) = max F^'\u^x). (110) 

Moreover, the maximum is attained on 

ii'te) = !((<?,XM), (111) 

where {X{q))s<q<t is the strong solution of 

dX{q) = ^"{q)ll{q)^{q,X{q))dqF^''{qY^^dB{q), (112) 

with X (5) = X. 


One ean eheek that |^| for / = d>v,<I>i or <1>2 is bounded by /3i + ^ 2 , so one eould in faet take 
L = Pi + P 2 in the definition of ^[sf]. 

Proof of Theorem I 20 I First, let us take t = v in Theorem[2]and use it for / = ^1 and <I> 2 . Let us 

denote by u*,u\ and u\ the eorresponding maximizers in (11111) . As we mentioned above. Theorem 
[T^implies that the funetions <l>i (v, •) and ‘I> 2 (v, •) are not identieally equal. This implies that u\ and 
u\ are not identieally equal (i.e. they have different trajeetories with positive probability). To see 
this, suppose that they are equal almost surely. Then Xi and X 2 are identieally equal, Xi=X 2 =X, 
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since by (lllll) and (11121) . 


Then (lllll) would imply that 

^(^,^(?)) =u\ = u *2 = ^^{q,X{q)). 

However, this is impossible beeause and are not identieally equal for any q, while the 
support of the distribution of X (q) is the whole real line M sinee, by Girsanov’s theorem (Theorem 
5.5.1 in |[20l l. the distribution ofX(( 2 ') is Gaussian under some well-defined ehange of density. 

Let us now show that 


4>v(5,jc) < A4>i(5,a:) -h (1 - A)<i>2(5,a:). (113) 

Using (II101) for / = d>v and (11061) . we ean write 

^y{s,x) ^ E^y(v,x + ^"{q)lJ,{q)ul{q)dq + {qA^^dB{q)'^ 

^''^d)B{d)u*Adfdq 

= x(e^i(v,x + ^''{q)ll{q)ul{q)dq +{qA^^dB{q)'^ (114) 

^''^d)Bid)KidAdq'^ 

+ {1-X)(e^2(v,x + ^"{q)B{d)Kid)dq + ^"iqA^^dB{q)^ 

^''^d)B{d)K{dAdq^ 

< A4>i(j',A:)-t-(1 - 

where the last inequality follows from 01101) for / = <I>i and <I> 2 . Moreover, sinee we already 
showed that u\ and are not identieally equal, this inequality will be striet if we ean prove that 
the funetional u —)■ F^’Au,x) in (11081) is strietly eonvex. The eomputation in Proposition 3 in If3l 
gives 

■^F^'^[{l-a)ui+au 2 ,x) < ^"{q)ll{q)dq-\^E ^"{q)ll{q){u 2 {q)-Ux{q)Adq. 

If Is^''id)Fid)dq < 1 , for example, if |v — 5 | is small, this shows that the funetional is strietly 
eonvex, so for s elose enough to v we obtain (11131) for all x. Beeause of this, if we take t = s instead 
of t = V and s <t and repeat the same eomputation as above, the equality in (11141) will now beeome 
striet inequality and will again yield (11131) . This finishes the proof. □ 
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8 Small values of the overlap 

Combining Theorem [T4l in the uncoupled case with Theorem [16] in the coupled case gives 

lim E/zda^ ■ p^l > JciC 2 + £) \ =0 (115) 

JV-J.OO \ ^ 'I 

for any e > 0. In the coupled case ci = C 2 = c. As we mentioned above, by Theorem 4 in Chen 
[[TOl, if E(/i“')^ = 0 then Cj = 0, and in this case there is nothing left to prove. If both > 0 

and E(/z^)^ > 0, it remains to appeal to Theorem 7 in Chen [[TOl . which shows that there exists 


that satisfies the following. 

Proposition 3 For any 5 > 0, there exists £ > 0 such that 

^ii^E(^/(^{|a^-p^l < VciC2 + e}\{|a^-p^-z| < =0. (116) 

Together with (11151) . (11161) implies that, for any 5 > 0, 

jimE(/(|ai-pi-z|>5))=0, (117) 

and this finishes the proof of Theorem [T1 


9 References 

[1] Aldous, D.: Representations for partially exchangeable arrays of random variables. J. Multi¬ 
variate Anal. 11, no. 4, 581-598 (1981) 

[2] Auffinger, A., Chen, W.-K.: On properties of Parisi measures. To appear in Probab. Theory 
Related Fields, arXiv: 1303.3573 (2013) 

[3] Auffinger, A., Chen, W.-K.: The Parisi formula has a unique minimizer. To appear in Comm. 
Math. Phys., arXiv: 1402.5132 (2014) 

[4] Austin, T.: Exchangeable random measures. To appear, Ann. Inst. Henri Poincare Probab. 
Stat, arXiv: 1302.2116 (2013) 

[5] Bray, A. J., Moore, M. A.: Chaotic nature of the spin-glass phase. Phys. Rev. Lett., 58, no. 1, 
5760,(1987) 

[6] Chatterjee, S.: Disorder, chaos, and multiple valleys in spin glasses. arXiv:0907.338 (2009) 


38 










[7] Chatterjee, S.: Superconcentration and Related Topics. Springer Monographs in Mathemat¬ 
ics. Springer, Berlin-Heidelberg, (2014) 

[8] Chen, W.-K.: Disorder chaos in the Sherrington-Kirkpatrick model with external field. Ann. 
Probab. 41, no. 5, 3345-3391 (2013) 

[9] Chen, W.-K., Panchenko, D.: An approach to chaos in some mixed p-spin models. Probab. 
Theory Related Fields 151, no. 1, 389-404 (2013) 

[10] Chen, W.-K.: Chaos in the mixed even-spin models. Comm. Math. Phys. 328, no. 3, 867-901 
(2014) 

[11] Chen, W.-K.: Variational representations for the Parisi functional and the two-dimensional 
Guerra-Talagrand bound. arXiv: 1501.06635 (2015) 

[12] Dovbysh, L. N., Sudakov, V. N.: Gram-de Finetti matrices. Zap. Nauchn. Sem. Leningrad. 
Otdel. Mat. Inst. Steklov. 119, 77-86 (1982) 

[13] Fisher, D. S., Huse, D. A.: Ordered phase of short-range Ising spin glasses. Phys. Rev. Lett., 
56, no. 15, 16011604,(1986) 

[14] Guerra, F: About the overlap distribution in mean field spin glass models. International 
Journal of Modem Physics B 10, no. 13-14, 1675-1684 (1996) 

[15] Ghirlanda, S., Guerra, F: General properties of overlap probability distributions in disordered 
spin systems. Towards Parisi ultrametricity. J. Phys. A 31, no. 46, 9149-9155 (1998) 

[16] Guerra, F: Broken replica symmetry bounds in the mean field spin glass model. Comm. 
Math. Phys. 233, no. 1, 1-12 (2003) 

[17] Hoover, D. N.: Row-column exchangeability and a generalized model for probability. 
Exchangeability in probability and statistics (Rome, 1981), pp. 281-291, North-Holland, 
Amsterdam-New York (1982) 

[18] Jagannath, A., Tobasco, L: A dynamic programming approach to the Parisi variational prob¬ 
lem. arXiv: 1502.04398 (2015) 

[19] Kallenberg, O.: Probabilistic Symmetries and Invariance Principles. Probab. Appl. Springer- 
Verlag, New York (2005) 

[20] Karatzas, L, Shreve, S.E.: Brownian Motion and Stochastic Calculus. Graduate Texts in 
Mathematics, 113. Springer-Verlag, New York (1991) 

[21] Mezard, M., Parisi, G., Virasoro, M.A.: Spin Glass Theory and Beyond. World Scientific 
Eecture Notes in Physics, 9. World Scientific Publishing Co., Inc., Teaneck, NJ (1987) 


39 



[22] Panchenko, D.: The Ghirlanda-Guerra identities for mixed ;?-spin model. C.R. Acad. Sci. 
Paris, Ser. I 348, 189-192 (2010) 

[23] Panchenko, D.: The Paris! ultrametricity conjecture. Ann. of Math. (2) 177, no. 1, 383-393 
(2013) 

[24] Panchenko, D.: The Paris! formula for mixed p-spin models. Ann. Probab. 42, no. 3, 946-958 
(2014) 

[25] Panchenko, D.: The Sherrington-Kirkpatrick Model. Springer Monographs in Mathematics. 
Springer-Verlag, New York (2013) 

[26] Parisi, G.: Infinite number of order parameters for spin-glasses. Phys. Rev. Lett. 43, 1754- 
1756 (1979) 

[27] Parisi, G.: A sequence of approximate solutions to the S-K model for spin glasses. J. Phys. A 
13, L-115 (1980) 

[28] Sherrington, D., Kirkpatrick, S.: Solvable model of a spin glass. Phys. Rev. Lett. 35, 1792- 
1796 (1975) 

[29] Talagrand, M.: Parisi measures. J. Funct. Anal. 231, no. 2, 269-286 (2006) 

[30] Talagrand, M.: The Parisi formula. Ann. of Math. (2) 163, no. 1, 221-263 (2006) 

[31] Talagrand, M.: Mean field models for spin glasses: some obnoxious problems. Lecture Notes 
in Mathematics, Vol. 1900, 63-80 (2007) 

[32] Talagrand, M.: Mean-Field Models for Spin Glasses. Ergebnisse der Mathematik und ihrer 
Grenzgebiete. 3. Folge A Series of Modem Surveys in Mathematics, Vol. 54, 55. Springer- 
Verlag, Berlin (2011) 


40 



